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ABSTRACT / / 

This paper provides a general description' of 
\scliema-theoretic models of language^ comprehensicn,.jLnd examines some 
extensions of such models to the stkxij of r^adingT The goal of schema 
theory is to\specify the interface /fcetween the reader and^ the ^ text: 
to specify how the reader •s knouleage interacts with and shapes the 
information on the page and to specify how that knowledge wust\ be 
organized to support the interacti^on. The general theory if 
illustrated witii an analysis of knowledge an^ processing a/t 
levels_of a good reader^s under stranding of Aesop**s fable, /"£ 
Soup": the letter and word level, the syntactic level, the semantic 
level, and the interpretive level. Ihe analyses illustrate that 
comprehension depends on the reader •s ability to relate Knowledge gtt 
textual information, both within and between levels of^nalysis. The 
power Df schema-theoretic models lies in. their c^'^^jsttj to support 
these ..interactions through a single, stra-^ified knowledge structure 
and ajfe\i basic processing meciianisBs. They ^provide a way of 
integrating xMir undersxanding /of text with our understanding of the 
world in geneVa.1. (AA) 
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, ..A SCriEMA-THEOftETIG VIEW OF READING 

^ \ 

At one level, reading can ^toe described" as the process of 
translating graphemic strings into spWen words. However, what we 
really mean by reaaing is not the ability to decod^^^;:v^i:ds but the 
ability to extract tne meaning, both ej^plicit and implicit, from 
tne written text. It depends on tne intricate coordination of our 
visual, linguistic, and conceptual information-processing systems. 
If 'we are to understand reading, we must find a way to break it 
0 down into a set of more tractable subskills and to identify their 
interrelations, - 

The standard approach is to begin ,wltn tn^s ultimate goal of 
tne reauer ana then to determine its prerequisites. At the 
hiqnest level, the reader has successfully read a passage if he 
understanas it both as it ''was intended by' the author and in terms 
of it-s^ impact on himself, Tnis presumes that the reader has 
extr^a'cted the information provided by the text, which in turn, 
aepenas upon nis having comprehended tne individual sentences, 
wnich depends upon his naving correctly processed the clauses and 
phrases of tnose s^tences, which depe.ids upon his having 
recognized tne component words of tnose units, which depends upon 

! 
i 

his having recognized their component letters, 

] when reading is analyzed in this way, tne component levels of 
processing appear to be organized hierarcnically , The attainment 
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of any given level presume^ the execution of^ all subordinate or 
less complex levels; moreover, the converse is not strictly true.- 
vmereas the reading of a written passage depends on the reading of 
its sentences, words, and letters, the dependency is, in some 
sense, unidirectional. An individual letter may be perfectly 
legible whether or not it is emDedded in a word, a sentence, or a 
passage^. Similarly, we are fully capaole of reading individual 
words and sentences in the aosence of a larger context. This 
asymmetry has been exploited by traditional analyses of readings 
For teachers, it provides a rational structure for instruct ional^\ 
programs: start at the bottom, with single letter recognition, and 
successively work up through tne higher level skills. For 
researchers, it provides a means o,f empirically isolating the 
processes involved at any given level in the structure: the 
etrects of higner order proqesses on the level in question are 
supposed to , oe null, and the effects 6f lower' processes can be 
empirically identified and suotracted outi, ; 

Tne problem with this approach^is tljat when we are reading a ^. 
meaningful passage, we are not r\eading its component letters, 
words, and sentences in the same way as when they are presented in 
isolation • Rather , processing at each level is influenced by- 
higner, as well as lower order information,' Thus, individual 
lexers become more perceptible when they are embedded in words 
(Reicher, 1969, ~ wheeler, 1970), Individual words are recognized 
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more easily wnen they are emoedded in meaningjLt,l^--^'sentences 
(Tulving & Gola, ISb^, Schubertn & Eimas , J^JT^'T^'^nf amil iar words 
may oe processed more easily^J^f-^'fieiT embedde'd in a familiar 
sto^y. (Wittrock, HarJ<^,-'«t'''Doctorow', 1975). Sentences that more 
conerently integrate^ tne ,underlying semantic relation^may be 
assmilated more easilyy.than tnose tnat do not, irrespective of 

tneir syritactic complexity (Pearson, 1974; Haviland & Smith, 

I 

1974). 



These sorts of interactions tremendously ease the task pf the 
skilled reader. BecauS'e of them, he is not obliged to grind 



:ougn every grapnemic detail of ^the written representation, 



tKV.oi 

Instead he may opt to process lower order information only as is" 
necessary ""lor checking his higher order hypotheses about the 
content 6f the passage. ^By contrast, these sorts of interactions' 
greatly complicate tne task of analyzing the reading process. 
Tney challenge the wisdom of bottom-up instructional strategies, 
and they all out nullify the generality of empirical findings 
based on "isolated" processes. Moreover, they leave us without a 
good working model of the reading process. \ V' • 

fce^cently, however, through the combined efforts of cognitive 
psychologists, linguists, and specialists in\ artificial 
intelligence, a new set of forrnalisms for analyzing language 
'comprehension has begun to emerge. These theories are, at^^ ^ > 
related to the old notion of a schema (Bartlett, 1932; Kant, 1781; 
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woodworth, 193B) . In the current literature, they are variously 
referred to as frames (e*g., Charniak, 1975; Minsky, 1975) and 
scripts (e.g., Schank & ADelson , .1975 ; Lehnert, 1977), as we^ll as 
schemata (e.g. Becker, 1973; Bobrow & Norman, 1975; Rumelhart & 
Or tony , _^ 1976) . we would argue that' 'schema theory for the first 
time provides a structure powerful enough to supfjort the 
Jjiteractions umong Different levels of processing in reading. 

In th rerTiairider of this chapter, we will first provide a 
general pescription of schema-theoretic models and the way they 
work, and then examine some extensions of the models to the study 
of readinc . A disclaimer is in order at this point. Many 
scnema-tneoretic models have been^ are Deing, and, will be 
developed, and there are some fundamental differences among them. 
In ■ view of this, we have not tried to provide a faithful 
oescr ipMon of any one model. Instead we gloss over controversies 
and aif irerehces between models in the hope of providing a coherent 
tutorial glimpse of the overall effort. 

SCtiEMA THEORY AWD LANGUAGE COMPREHENSION 

A fundamental assumption of schema-theoretic approaches to c^/ 
language comprehension is that spoken or written text does not in 
itse.lf carry meaning. Rather, a text only provides directions for 
tne listener or reader as to how he should retrieve or construct 
the intended meaning from his own, previously acquired knowledge. 

- 4 - 
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The words of a text evoke in' the reader, associated concepts, 
tneir past interrelationships and ' ' their potential 
interrelationsnips. The organization of the text helps him to 
select ^rnong tnese conceptual complexes^' The goal of schema 

0 

theory is to specify the interface between the reader ar.d the text 
to specify how the reader's Knowledge interacts and shapes the 
information on the page and to specify f dv/ that knowledge must, be 
organized to support the interaction. = 

Struct ural urganization of Scnema-Theoretic Models 

_ . A schema is a description of a particular class of concepts 
and is composed of a hierarchy of 'schemata embedded within 
.schemata. Ihe representation at the top of the hierarchy is 
sufficiently general to capture the essential aspec):s of all 
members of tne class. For example, if the conceptual class 
represented by a schema ytere "going to a restaurant" (Schank & 
Abeison, 1975), its top level representation would include such 
information as that a restaurant ; s a commercial establishment 
where people pay money to have someone else prepare their food and 
clean up after them. At_the level beneath this global 
characterization, are more specific schemata (e.g., going to a 
diner, going to a fast hamburger operation, and going to a swanky 
restaurant). In general, as on© moves down the hierarchy, the 
number of embedded schemata multiplies while the scope of each 
narrows, until, at the bottom most level, the schemata aoply to 
. \ 
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unique perceptual events. Ehcn schema at each level in the 
hierarchy consists of descriptions of the important components of 
i-t-s .neaning and their interrelationsnips , where these descriptions 
are tnemselves schemata defined at the appropriate level of 
specifity. The power of this structure derives from the fact that 
the top lev4l representation of any schema simultaneously provides 
ah abstraction" of and a conceptual frame for all of the particular 
events .that fall within its domain. 



Because the top level description. of a schema must pertain to 
every member of its class, many of its components may be but" 
vaguely specified, for example, in the restaurant schema very few 
properties of tne place to b e served could be extended to ail 
•possible members of that class, be they any variety of booths", 
tables or counters; accordingly, very few properties could be 
explicitly attached to its 'superordinate description. On the 
other hana, tne most general schema for the place to be "served in 
a restaurant effectively contains all of tne service arrangements 
one has experienced, or, equivaiently , the collective features of 
tnose service arrangements weighted in terms of their likelihood 
in different, contexts.' Thus, while°no specific value is 
ar^tdcipated, a stereotype is defined:,- in the absence of further 
information, the concept is still meaningful. 

Because the schema specifies the interrelationships between 
its und.erlying components, once any element is specified,, it can 
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oe understood in the proper context. .For example, if -,3 counter is 
raentionea within tne restaurant schema, it can immediately be 
understood as a place at which food can be served and not as art 
abacus or a parrying boxer's blow. Moreover, the introduction of 
a bounter might be sufficient to eliminate swanky restaurants from 
consideration,, thereoy indirectly narrowing the probable range for 
Other, an yet. unspecified component, of the restaurant schema. 

Any important element or' scnema within a schema may be 
tnought of as a s lot (Minsky, 19'/5) that can accept any of the 
range of values that are compatible with its associated schemata. 
Tne^colnptenension of a specific situation or story involves the 
""^process of instantiation whereoy elements in the situation are 

0 

Douna to appropriate slots in the relevant schema. This process 
not only serves the ou^rpose of filling out the details of the 
schema, but also of temporarily connecting it to characteristics 
of the bound schemata. Tnus, if there is a nervous old man in the 
story who takes the order in the restaurant, he will be i .nd to 
the waiter role. rfc subsequently the waiter knocks over a glass 
of water, tnis fact will be related back to the nervous quality of 
tne old man currently assigned to tne waiter rcle. Often, a text 
./wi\ll not explicitly provide tne element to be bound to a 
particular slot 3ven though it is an integral component of some 
relevant schema. In tnese cases, the reader may assign default 
values. The default assignment will be determined by the values 
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assoc-iateu witn its ?Lou. Tne precision of the default 
description will depend on the specifity of those values. If one 
know that the restaurant in the story was swanky, the default 
assignment might be that the customer sat a,t a table; if one also , 
Knew it was c.n autjnentic Japanese "restaurant, the default 
assignment might be that the customer sat on cushions rather, than " 
a cnait; it the stcry were about a particular, familiar Japanese 

cv 

o 

restaurant, tne default assignment might^^be very elaborate. 

ijlg_^^Qg.g§-gj:"g of Information 

Witnin scnema tneory, the process of interpretation is guided 
ny tne principle that all. data must be accounted for (Bobrow & 
worman, Every input event must be mapped against some 

scnema, and all aspects of that schema must be compabible with the 
input information. Tnis requirement results in two basic modes of 
information processing. The first mode, bottom-up processin g, is 
evokeo Dy the incoming- data. The features of the data enter the 
system tnrough the best fitting, bottom-level, scnemata. As these 

0 

scnemata converge into higher level schemata, they too are 
activated. In this way, the information is propogated upwards 

0 

tnrough the hierarchy, through increasingly comprehensive levels 
of interpretation. Tne other mode, top-down processing ,° works in,^ 
the opposite direction. Top-down processing occurs as the system 
searches tor information to fit into partially satisfied, higher 
oruer schemata. 
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An important aspect' of a schema -theoretic account of readinq 

o 

'comprehension, is that top-down and bottom-up processing should be 
occurring at all levels of analysis simultaneously (Rumelhart, 
1976). -fhe data tnat are needed to instantiate or fill out, the 
scnemata become available through bottom-up processing; top-down 
processing f°acilitates tneir assimilation if they anticipated or 
are consistent with the reader's conceptual set. Bottom-up 
processing insures that tne reader will be sensitive to 

o 

information that is novel or that does not fit his on-going 
Hypotheses about the content of the text; top-down processes' help 
nim to resolve - ambiguities or to select between alternative 
possible interpretations of the incoming data. ^Through the 
interactions oetween top-down and bottom-up processing, the flow 
of information through the system is considerably constrained. 
jA^en so, these processes are not, in themselves, enough to ensure 
apt con[iprehension. / 

I'ne notion that tne human mind is guided by a central, 
limited capacity processor is, by now, 'taken for granted within^ 
many psycnological theories of informat ion-process ing . ^^^^yfh^ 
general" acceptance of tnis notion among psychologists^^as been , 
principally due to empirical demands.. Recently, h^ever, Bobrow 
and Norman (ly75) have argued that Some suph^onstruct must be 
' incorporated into any schema-theoretic ^ty'pe of system, be it 
'person or machine, if „its responses to its environment are to be 

0 

rational ana coherent. 

o 
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* boDrow a.na Norman's^arjgument ^is based on three observations. 
First, in order for a system that is so diffuse and receptive to 
.maintain coherence, it must, be imbued with purpose. In their 
words (.p. 146), "Witnout purpose, the system will fail to pursue a 
line oi inquiry in any ! directed fashion." Moreovei: , too many 
purposes can oe the same as! none. Their second observation , xs 
relatea: individual purposes are by definition, single-minded. ,In^ 

o J 

\ ^ 

order .to select among ; d>£rter-en-t^, — aBd__Dossibly conflicting 
purposes, tne system must^ave some more global self-awareness or7~ 
in dobrow and NonpaVs words, ''a central motivational proces's." 
rnird, some m^cnanism wnich'has access to all memory schemata must 
guide tne interpretive process. This is necessary in order to 
dep^Tde wnen a schema nas been adequately filled out for the 
current purpose, to evaluate tne goodness of fit of the data to 
the scnemata, and to detect and appropriately connect metapiior ical 
or analogical reference?:?. Tnese observations led Bobrow and 
tMor:nan to conclude that the schemata must culminate in so^e 
central, omniscient processor — a grand self schema, if you will. 
Tne primary responsibility of this processor is to adaptively 
allocate the limited resources for active processing amqhg the 
various activities of tne system. ^ 

•xaKing this notion back to the schema-theoretic model, we see 
tnat there are two oasic ways in which the processing capabilities 
oh tne system may be limited (Norman & Bobrow, 1975). First, 

- 10 - 
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there, may be some difficulty in mapping input data to the memor.-y 
stfu?:ture with- the result that their normally automatic, bottom-up 
propagation through the system is oDstructed; in, this case, the 
system is data-limited. Second, the various, simultaneous d.emands 
for -active control may exceed the system's capacity to cope; fn 
this case, the system is resource-limited and the execut/ion of 
some of tne ongoing activities will be compromised. Both kinds of 
limitations are relevant to the reading process. 

Norman and Boorow (1975) have distinguished two types of 
-■^data-limits on proCes^sing '. The definitive characteristic of each 
is that .no amount of effort on the interpreter's part will 
eliminate .the proDlem.^ Tne first, signal data-limits , occur when 
the quality of the input confuses the mapping process., as, for 
example; when ot^e is listening .'for faint signal in a noisy 
environment. ^ Examples of signal data-limits in the reading domain 
range from the deciphering of poor handwriting to the 
comprenension of a wholly incoherent passage. For the second kind 
of ciata-limits, memory data-lim its, the quality of the input'' may 
be impeccable, but the mapping process is obstructed for lacktof 
app'topriate memory structures. Bofen of us would, for example, 
su/fer_from^a^me;iiory data limit in trying to understand a Japanese 
-speecn; since we know no Japanese, we could not, with any amount 
of effort, succeed, with respect to reading, problems related to 
memory data-limits are pervasive.' For the beginning reader, they 
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may occur ,at the level of single letter recognition. For more 

1 ] 

experienced readers, tney may persist at the levels of word 
recognition, syntactic analysis, and of course, in any dimension 
of semantic interpretation. 



As an example of resource-limited processing, Bobrow and 
uorman describe the familiar situation in which one is 
simultaneously driVing a car and carrying on a conversation. Both 
activities can be managed as long as^ they are proceeding- as 
expected. If one, however, absorbs inordinate attention, rt does 
30 at the expense of the other. Surprising news may result in, bad 
ariving; a Dusy intersect ion^ may provoke a pause in the. driver's 
speech or distract him trom liste^fing. The analogy exists in' the 
reading *^situation o — we can /tolerate more or less distraction 
while reading, depending ,o,n the difficulty of our material or ''our 
reasons for reading it, 



but, 'with respect to reading, the more critical problems 
related to resource-limited- processing arise when activities 
suDserv.ing the same end compete for attention. If their 
respective demands cannot be, met, the comprehension process breaks 
down, A good reader may encounter this problem when, for example, 
he is trying to read a legal document or a scientific paper that 
is outside of his area of expertise; he may devote a lot of energy 
toward understanding tne words ana sentences , only to find that he 
nas not understood the meaning of the paragraph. For young 
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readers, this Kind of proDlem may be .especially frequent since 
many of the subskiils and concepts presumed by a text may not yet 
be well learned or integrated. 

SC'fiEMA TtiEORY AND* READING COMPREHENSION 

"A crucial idea for ; a schema-theoretic account of reading 
comprehension is tnat it involves the coordinated activity of 
scheniata at all levels of analyses. As schemata at. the lower 
levels '*(e.g., visual features) are activated, they are bound to 
and thus evoke schemata at the next, higher level (e.g., letters); 
as tnese schemata are activated, they, in turn, trigger their own 
sup^rordinate schemata (e.g.", words). In - this way, through 
Dot£om-up processing, the input data are automatically prorogated 
up the nierarcrfy toward more meaningful or comprehensive levels of 

, representation. At the same time, schemata at higher levels are 
competing to fill their slots wJ-th elements froiHr, the levels 
beneath through top-down processing. Again, the theory is that, 
for the skilled reader, both top-;d.own and bottom-up processing are 

7t)ccurring simultaneously and at all levels of analysis as he* 
proceeds through the text (Rumelhart, 1976) . 

k necessary assumption here is that schemata exist at all 
levels of abstraction (Aoelson, 1975; Rumelhart & Ortony, 1976) . 
At the letter level, the schematic descr ipt ions' may be relatively 
concrete and specific. For example, the schema for an uppercase K 
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[ mignt consist of^ three subschemata : (1) a vertical line on the 
left; (2) an^'oDlique line extending upwards from near the center 
of the vert ical* line to a point to the right of and perpendicular 
\^%ith the top of the vertical line; and (3) a second oblique line 
'extending downwards from some where along the bottom half of ^ the 
first oblique line to a point directly beneath the top end of the 
first oulique line and perpendicular to the bottom of the 'vertical 
line. 

At the other extreme, schematic descriptions may be very 
aDstract and -rgene'K^al. ' As an; example, consider Rumelhart & 
urtony's (1976) 'tentative verson of the 'problem solving schema. 
In it, tnere ate three variables: a Person P, an Event E^^ a'nd a 
Goal Tne schema nas a two step structure: ". 
1« E causes P to want (3; 

^j2. P tries to get G until P gets G or until P gives- up. ^ 
Eacn ot tne elements like cause, want, and try an this-schema are 
tnemselves schemata, just as the letters in the schemata for words 
are themselves scnemata. Rumelhart and Ortony's version of the 
try scnema has two variables whicn are bound in the problem 

. solving schema: a Person P, a Goal Q. The proposed steps are: ^ .. 

1. P decides on an action A which could lead to G; 

2. wnile any -precondition A' for A is not satisfied, P tries to 
get A' ; 

3. P does A* 
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Thje problem solving and trying schemata reflect what Newell and 
Sinon (1963) , have called means-ends analysis. In means-ends 
analysis, whenever ^ goal cannot be obtained directly, an 
apjiropriate subgoal is set up. This subgoal may itself be 
redursively dissolved into sub-subgoals , until a stepwise means 
nas Deen found to attain the original goal. We would argue, as 
hav4 Newell and Simon (1963), that just such problem solving 
Vaaes many human motivations and actions. It follows that a 
■understanding of many stories by and about people, depends on 
I able-^to interpret their events in terms of something like 
the problem solving aAd trying schemata that" Rumelhar t and Ortony 
■ nave outlined. \ 

-The 'power .of a schema-theoretic account of reading derives 
from the assumptioh that lower level schemata are'^^elements or 
subschemata--wi-tMn higher level schemata. It is, above all, this 
aspect of the\heory that allows perceptual elements to coalesce 
into meaning, that allows such abstract, higher order schemata, as 
the problem solving schema, to be appropriately and useful>y 
acces^d. Moreover,, it is this aspect of the theory 'which 
provided a structure for conceptualizing the interrelationshios 
between levels of processing . 

I-.-: order to give a more detaivj^d description, of what is 
Vieoretically happening as one reads, it is easiest to consider 
different levels of processing as if those levels were separable 
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(Which they are*- not) • In the next four sections of this chapter, 
we will deal successively with lej>ter"^nd word processing, 
syntactic processing, semantie'^'process Ing , and processing at the 



interpretive level. In each case, the basic argument in favor of 
a schema-theoretic explanation of these processes is "that they 
cannot be explained in terms of bottom-up processing and that the 
bop-down influences seem to be too automatic and too well 
structured to be attributable to simple guessing. 

we will describe these processes in terms of how fa skilled 
reader might arrive at an understanding of the -following fable: 

"i 

Stone Soup ' ■ . 

A poors man- came to a large house during a "storm to 
Deg for food. He was sent away with angry words > but he 
went. Dack and asked, "May I at least dry my clothes ^T)y 
^-^he fire, uecause ^ I am wet from the rain?" The maid 
thought this would not cost anything, so she ;let him 



come in. 



Inside he told the cook that if she would give him 
a pan, and let him fill it. with v/ater, he 'would make 
some stone soup. This was a new dish to the cook, so 
she agreed to let him make it. The man then got a stone 
from the road and put it in the pan. The cook gave him 
some salt, pea's, mint, and all the scraps of meat that 
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she could spare, to' throw in. Thus the poor ^ man 'ma^e a 
deldcious ston^-^oup and the cook said, "Well donel You 
have ^jiiade a wonderful soup out of practically nothing," 

— Aesop 



Knowledge and. Processing at the Letter and Word Levels 



The first step towards understanding the Stone Soup story is 
thatj of recognizing the words. The processes involved in 
recognizing written words have Deep "a topic o"f fj^rolonged debate 



V 



amorig\educato^s and psychologists, dn one side, there are those 
who argue that word recognition must be mediated by more 
elementary activities^. liKe letter identification; on ^the other*, 

there ^ale tnose who argue that words are recognized whol istically . 

f ' i ' , * ' 

Tnei^ first position has many practical arguments in its. favor. 
First, jfor example, tne pattern analyzing -mechanisms th^at must be* 

^- ■ i' 

posited ^ould be far less cumbersome if , the ' system worked on 
single letters, or even their elementary features, than if it 
workea or^ whole word patterns. The importance of this argument is 
stressed when one considers the innumerable- var iety of type styles 
and scripts that are legible. Second, there must be some 
connection in the system between written and spoken language, and 
our alphabetic cipher provides a natural candidate, for such^ a' 
link. In addition, it provides a means by which unfamiliar 
written wdrds that are familiar in their spoken expression, can be 
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"decoded." However, the potential advantages of an alphabetic 
language are denied if letters are not functional stimuli in 
reading. Third, thorough instruction in letter-to-sound 
correspondences has been shown to be an important component of 
early reading curricula (Barr, 1974; Chall, 1967); by implication- 
these correspopdences, or some aspect of the analysis they 
involve, must be useful to the reading process. ■ 

In support of the other contention — that people recognize 
words wholistically — is the fact tnat people act like that's 
what.they do. Certainly skilled readers are rarely aware of- 
reading - in a= letter-by-letter fashion. Moreover, experimental 
studies have shown that whole words can be perceived at least as 
(Quickly and accurately as single letters (Cattell, 1886; Reicher, 
I9i69; Wheeler,' 1970) . ^ . ■ 

The most reasonable solution to this dilemma is /that the 
•process of recognizing written words involves analyses at both the 
letter and- the word level, and that these analyses Qccur 
simultaneously and interact with each other. Recently, Adams 
(1975) ran a series of exper iments* compar ing the visual processing 
of words, pseudowords/"\and or thographically irregular non-words, 
which yielded direct /Support f oi:. ; this;-: explanation* She then 
proposed a model jhich ''is'"^vecy much in the spirit* of schema 
-theory. / 



The basic assumption underlying Adams' model is that any set 
of internal units or scnemata that are repeatedly activated at the 
same time, become associated such that the activation of one of 
them facilitates the activation of ti.^ jthers. The essential ide'a 
of tne model is that the extraction of visual information proceeds 
in the same way for words, pseudowords, and or thographically 
irregular strings, and that their differential perceptibility is 
due to interactions between tne schemata against which the visual 
information is mapped. These interactions are illustrated in 
Figures 1 and 2. 

' ' Ihe circles" in Figure 1 represent letter recognition 
scheiTiata, the arrows represent associations between them. The 

full circles correspond to schemata^ receiving activation from both 

J. 

an ''external stimulus and other activated schemita while the broken 
circles correspond ^to those receiving ^activation from other 
schemata only. Tne degree of inter facil itation should 'be 
determined by both the strength of the external input and the 
strength of the association, where the' latter is presumably a 
function of the letters* nistory of co-occurrence. The strengths 
of these interletter associations can therefore be estimated . from 
transitional probaoilit ies , as has been done in this Figure. 7:: v 

Insert Figure 1 about here 

. This structure would predict' a considerable perceptual 
advantage of words and pseudowords over or thographically irregular 
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STIMULUS 



(a) THAT 




(b) YOTH 




(c) lYTN 



Associated letter network. (From Adams ,^ 1975) 
- 20 - 



.nohwords,< especially given »that the extraction of visual 
information proceeds in parallel. That is, inter facil itation 
between the ' component letters of words and pseudowords would' be 
mutual and coincident with external input, with reference to the 
example in Figure lA, the T, the H, and the A would- all be 
simultaneously receiving , external .activation from the stimulus and 
internal activation^Jfojii each other. By contrast, the activation 
of .the com^nent letters of nonword strings, as in Figure IC, 
would depend alm^at entirely on external input; since the 

^transition probabilities between the adjacent letters' of irregular 
nonwords are quite small, their mutual facilitation must also be 

.minimal. 

\ 

t 

In order to elkplain the perceptual advantage of real words 
over pseudowords a second, lexical tleve^- of analyS,!^ niust be 
included in the model. This level is diagrammed iKFigure"v2. The 
connections between the lexical schemata and the letter sc?»emata 
represent the associations between ^ them. \The weightings of these 
associations are supposed to depend on lo^normal word -frequency. 
AS. the individual letter schemata receive input, they relay 
activation to all appropriate word schemata, and as a given word 
schema becomes active,^ it proportionately' and reciprocally 
facilitate-s the leiter schemata corresponding to its component 
iette.rs. 

■■ - Insert' Figure 2 about here 

0 
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STIMULUS 



(0) THAT 



(b) YOTH 



(c) lYTN 



Figure 2. Associated' lexical network. .(From Adams, 1&'75) 
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In terms of schema theory, Adams is positing two kinds of 
interactive processes that go on simultaneously in' recognizing 
words: the first depends on interconnections between schemata at 
• the letter level, wh-ere one letter triggers an expectation for 
another letter; the secpnd depends on. the structure within 
schemata at the wora level, where competing words are looking for 
letters to fill tneir respective slots. 

what happens concurrently at the feature, letter, and word 
levels as the ,reader scans through ' tne Stone Soup story is 
something like this. The eye colle'fcts information about different 
visual features that are present. These are features that are 
automatically bound to slots that they fit in the -letter schemata. 
Heanwhile, partially instantiated letter schemata arc- trying to 
find the appropriate visual features to fill their remaining 
slots. In addition, they are facilitating other letter schemata 
.that correspond to likely neighbors and, finally,, fitting 
themselves to slots in the word schemata. While all of this is 
happening, partially activated word schemata are trying to 
identify the appropriate letters for tJ)eir own unfilled slots. • 

A natural extension of Adams' model would be that word 

C 

schemata facilitate other' word schemata that aire likely to occur- 
in the same sentence. Tnis extension could explain the semantic 
priming effects that have been reported in the psychological 
literature (e.g., Scnuberth & Eimas, 1977; Meyer, Schvaneveldt 



Ruddy, 1975; Tulving & Gold, 1965)\ iMt when a person is reading 
connected discourse, syntactic and hig'.ier order semantic knowledge 
must, also oe influencing the identification of words. As 
described Delow, 'words themselves are subschemata within these 
. higher level schemata. ^ 

Knowledge and Processing at the Syntactic Level 

Perhaps mo?e than anything else, it was Chomsky's (1957) 

o 

"Review of SKinner ' s^ Verbal Learning," that dealt tlie death blow, 

to bp'utom-up theories of synt^atii processing. Chomsky argued 

cogently that "in building a descr iptive- ^^^nodel of . linguistic 

.behavior, the ".. .elimination- of the independent contribution of 

tne speaker and learner ... can be achieved only at the cost of 

eliminating all significance from the - descriptive ""system, which 

treiv operates at a level so gross and crude that no answers are 

sugqestte.d to the most elementary questions" (p- 30). In other 

• ' - \ -"7 

words, top-down processes ■ mus-fe be incorporated into mode: of 

! V. ' "" t 

syntactic pr ocessing^H f fchey are to have any explanatory power. 

Recent experimental evidence not only supports the contention 
that syntactic analysis is guided by top,-down processes, but, 
further, indicatC'S th?t this happens in a way that is consistent 
witr 3chema theory. That is, the syntactic processing of a phrase 
occurs jiot subsequent to, but in parallel with the processing' of 
its lexical elements (Mar slen-Jviison , . 1973; 1975; Wannemacher, 



M^' ^'^'^'^j/^ '-Moreover, the syitac'tic hypotheses interact with and thus 



, ....r: 



• -f-acili,tate the ilowe\ leypl processes (Marcel, 1974; MarslU-WiXson 
g-: Tyier, 1975) . ' ' • - <ifV-^--4 

' "t'he 'most- powerful' formalisms that researchers in 

- ^^^''^'■P'^^ intelligence have developed for syntactic processing is 
the augmenj:ed tr^nsitian network (ATN) "grammar. (Woo'ds/ 1970)-. 
f.j « Recently exper imejital evidence has been accumulabing^h.at, ATN 
theory provides /at least a plausible account of human' Syntactic 
pr6cessing (Stevens and Rumelhart, 1975; Wanner and MaratsolT 
1975). 

The ATN formalism is best explained in terms of ,a small 
network that can parse a.subset of English. There exists an ATN 
..grammar for most of English (Woods, Kaplan, and -"Mh.rWebber " 
1972),' but it is complicated to understand. Figure/s shows a 
sample network for analyzing Englisn sentences (S) |rom Woods 
(1970), an-d associated), net.works for analyzing . noun Jirases (NP) 
'and prepositional phrases (pp) . The arcs (or pointers/ in the ATN 
formalism act like slots in the schema formalism. " Tl>{js, going out 
from the S state in Fiqure 3, any auxiliary will satisfy the lower 
arc. "Auxiliary" defines the range of values that can satisfy 
that arc (or slot). The ATN formalism, however, has no notion 
equivalent to default values in the schema formalism. Lik'e- 
schemata, ATN networks are embedded: going along an NP arc in any^.. 
network means jumping to the NP-network to analyze a noun phrase. 
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By allowing whcJle networks to ^replace arcs, the network for 
analyzing noun phrases need only be specified orice. This is the 

same" kind of power that comes from embedding in schema or semantic 

*. ' 

network theory: one can have a schema for "trying" or a 
"restaurant" which can be referred to in a wide variety of 
different places by higher level schema, so it need only be 
specified once^ '^At^J. networks' can in fact be viewed- as procedural 
schemata for representing syntactic knowledge. 

V \ Insert Figure 3 about here 

* woods (1970) describes how the ATN network in Figure 3 

analyzes sentences as follows: 

/ 

"To* recognize the s.entence "Did the red barn collapse?" the 
network is started in state S. The first transition is the aux 
transition to state q2> permitted by the auxiliary "did." From 
statie q2 we see that we can get to state q3 if the next "thing" in 
the input string is an NP. To ascertain if this is the case, we 
call the^ state NP. From state NP we can follow the arc labeled 
dec to state q6 because of the determiner "the." From here, the 
adjective "red" causes a loop which returns to state q6, and the 
subsequent noun "barn" causes a transition to state q7. Since 
state ' q7 is a final state, it is possible to "pop up" from the NP 
computation and continue the computation of the top level S 
beginning " in "state q3 which is at the end of the NP arc. From q3 
the verb "collapse" permits a transition to the state q4, and 
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Figure 3.- A sample transition network. S is the start state, 
„ g4» 85, 87, g8>, and are the final states. 
(From Woods, 1970) 
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since this, state^ is final and "collapse" is the last word in the 
String, the string is accepted as a sentence [pp, 591-592]," 

Most ATN parsers that have been developed to date have been 

tpp-down processors: the parser starts oGt Ipokiag for a sentjence 

in tne S network, and the parser wll fail if the input is not a,' 

well formed string according to the grammar/ But there is nothing 

\ ' ^ ' 

about the ATN formalism that is inherently top-down. In fact, 

Woods (1976) has recently developed an ATN parser, that proceeds In 

bottom-up fashion from the words first identified. This is 

important in speech processing, where the small function words 

tnat^are crucial for top-down syntactic processing are the most 

difficult words to identify pnonetically in the speech stream. In 

numan compr enens ion , we envision both a top-down process, as most 

ATN grammars are currently designed-, a^d a bottom-up process 

proceeding outward from the first words recognized to identify 

noun phrases, verb phrases, prepositional phrases, etc. 

At the syntactic level tnen, the reader 's 'processing of the 
Stone Soup fable must be something like the following. ' From the 
top down the reader starts looking for a sentence. There is a^ 
high pro;tability that a sentence starts with a noun phrase (i,e,, 
arcs must have frequencies associated with them as in Adams' model 
in Figure 1), and so the reader's initial expectation may be for a 
noun phrase, which "A poor man" satisfies. But different words in 
the sentence trigger expectations in a bottom-up fashion: "a" is, 

- 28 - 



^.usually followed by an a'djedtive or noun; "man" is likely to be 
the final state* in a noun phrase and therefore triggers 
expectations for determiners, ad ject ives^j/'aiq^"'possess ives to the 
left and a verb phrase to the right. Thus, the nature of 
syntactic constraints is ^different from word and letter level 
constraints, but they operate in tl^e same top-down and bottom-up 
patterns. Fur thermore^/ they opetate in conjunction with 
constraints at the .other levels to- determine what^ the reader 



comprenends, 



Knowledge and Processing' at the Semantic .Level , 

In reading - the Stone Soup fable the skilled reader fills in 
many details that are not in the text. For example'', 1) that the 
man came to th.e house because he was hungry and the maid sent him 
away, because she didn't want to give away her master's food, 2) 
that the poor man asked to dry himself by, the fire because he 
tnougfit the maid might let him in and he wanted to get into the 
.nouse so he could get some food, 3) that the maid let him in 
because she felt sorry^ for him and did not realize his request was 
a ploy to get food, 4) that the man suggested making stone soup' 
because he though the cook might be fooled into thinking that a 
stone could be used to,- make soup, and , if so', she would throw in 
scraps of food as she normally^does in making soup, 5) that the 
cook agreed because she thought the mar\ knew about a novel dish, 
an"d she^ did' not realize he had invented the dish as a ploy to get 



I 
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food, 6) that the cook did not realize that the man had 
contributed nothing to the soup and 7) that the reason the soup 
tasted good:'' was because of the ingredients the cook added. None 
of the§^' motivations and causal connections are in the pasaage 

rtself • - - ' V ' ' . \ 

' ^ ' \ ^ ^ "A 

There is a large . amoun^. of the reader's world knowledge '^that 
must:^""ble~^ invoked in order- to construct such an interpretation for 
tne Stone Soup fable. Table. 1 shows what ^^fne of that information 
mignt look like in schema-^theoretic ter-itfs^. 

\ Insert Table 1 about here ^ 



The process' of comprehending the passage at the semantic 

level must be something like the following. The fact that the' man 

/ 

IS poor, triggers the notion that he does not have much money or 
wealth. The large house he comes to, therefore, must not be his 
own 'house. Begging is one means of obtaining food (see How to 
obtain goods in Taoie 1), and the fact that the man does not have 
money satisfies the precondition for begging. Because the reader 
tries to interpret actions in terms of the problem solving and 
tryijig schemata, he will bind the poor man to the person Pvin both 
schemata, and the begging of .food to the action A in the trying 
schema that could lead to some gbal G. Because no goal and no 
initiating event are sfJ.ecified in the story, the r-eader makes the 
default assumptions that the man is hungry (event E) and his goal 
G is to eat. It is the need to satisfy these slots in the problem 
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Some •^world Knowledge Schemata Ne eded for Stone Soup Fable 

: - / 

A maid \ ' / 
V. / 

1. A woman servant^Pl who cleans and takes care of residen.ce I fqr 
" . master and/or mistress P2. 
^ 2. The goal of PI is to please P2. 

3. P2 pays ^1 with money and/or by providing room and board. 

HOW to please master 

0 

1. A person PI can please a master P2 by working hard, by being 
nice to P2, and oy protecting P2's property. 

how to obtain goods ^ •* 

1. If a person PI has money M, PI can buy goods G from a store ^ I 

ft 

or person P2 possessing G. 

2. If- a person PI has no money M, PI can borrow M or PI can steal 
goods G from a store I or person P2 possessing G, or beg for G 
from P2, or con P2 into giving G. 

how to con somebody 

1. If a person Pi has a goal Gl, and 

' <» 

2. If another person P2 has a means M and a goal G2 to prevent PI 
from obtaining Gl, and 
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TABLE 1^ (continued) 

3* Lt PI performs an action A which P2 thinks is directed tow^^'S"^ 
different goal G3 and which leads PI to obtain Gl without' P2 
giving up eitner" M or G2, 

4. Then PI cons P2 by doing A. , 

riow to make soup X * * ""^ ^ 

A person PI puts potable liqiiid in a pan. 

2. PI adds a large quantity of food X or a base for meat stock X 
1 like soup bones or scraps-. 

3. PI adds' spices and other^bits of food F that are available. 

4. Pi cooks over low heat for a long time. 

/ 
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solving ■ sch''ema tk^t forces these assumptions . Obviously they 
could be wrong; •the\man might be seeking food/ for his dog" or 
casing the house to rob it, but the default values are assumed 
unless and until the reader is forced. to revise them. 

when the poor man is sent away with angry words," the reader 
similarly njakes a uefaulc assumption that a resident of the house 
sends the. pc^r man away, not because tne poor man offended the 
resident but in-order to preserve property (i.e. food), when the 
poor man comes back for permission to dry his clothes, this 
doesn't fit the earlier gc^l of wanting to eat, so the reader 
assumes that the poor man's goal has changed to getting dry from 
the storm mentioned in the first sentence. The reference to the 
maid -in the last sentence of the first paragraph binds her to the 
resident tnat sent the poor man away originally. To fill the 
slots ,.in the. problem solving schema, the reader assumes that the 
maid's goal in- letting the beggar come in is to make him happy, 
out of a general kindness to the poor. This is reconciled with 
her earlier refusal of food, because the action taken in this case 
does not violate the means by wnich she can please her master (see ' 
Table 1) . . 

Inside, the man apparently adopts a'nother new goal, of 
teaching the cook how to make stone soup. The reader has no 
schema for making stone soup; it is news to the reader as well as 
the cook. But the reader, in order to understand the story, must 
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haye^a schema liKe that in Table 1 as to 'how to make soup in 
-geaeral. One of the conditions for making soup is violated, 
namely that the basic ingredients be edible or meat bones ^r 
scraps. This triggers the reader to look for another goal" for the 
poor man's actions. The fact that_the cook put a lot of scraps 
into , the soup means that. she has supplied the base for the soup. 
This suggests that the man's original goal of getting food might 
be hi,s goal in making stone soup. There is nothing in thT' story' 
that says he . eats the soup, but the cook says the soujr tastes- 
good, which Hmples that it has been made. The default value when 
people perform some task together is that both share the fruits ot 
the labot, so that the reader should assume the poor man gets to, 
.'eat the soup. Therefore, the reader, can" make sense of this 
episoae in terms of , the man's reaching his original goal of 
obtaining food . 

Furthermore, if the reader is clever; he will see he can 
reduce the number of independent goals for the poor man to one, if 
the man's request to dry himself by the fire is interpreted as a 
subgoal to getting into the house,, and getting into the house is, 
in turn, a subgoal to getting food. This interpre ation works 
because an alternative to begging for goods is conning someone for 
goods (see Table 1). The way the con operates here is that the 
man has the goal to get food, which the maid wants to prevent. By 
asking to "dry himself by the fire the man takes an actio'n which 



- 34 - 



ERIC ^ . . ; / 



leads to getting food, but which the maid thought was directed to 
'getting dry. Thus, she misinterpreted his action and was conn^^rd. 

A still more difficult inference is to -see that the man 
conned the cook as well as the maid. To make this inference the 
reader must infer.' that the cook also would have refused the \an 
food,. In the case of the maid, this is revealed by her actions. 
In the case of the cook, it jnust*be inferred from the fact that 
she too would want to please her master by preserving his 
property. Furthermore, the reader must infer both that the cook 
believed that l^he man's goal was to make soup from a stone, and 
tnat his real goal was to get her to give him some food. We saw 
now the reader could realize that the man's goal was to obtain 

c 

food. The clue that tne cook did not understand the man's goal is 
only indirect; she^marvels at his having made a wonderful soup 
out of practically nothing, which implies she does not see that it 
was she who contr ibuted ^ all. of the substantial ingredients to. the 
soup and that he and his stone added nothing. ^ Therefore, she too 
.was conned by the poor man. 

Thus, the skilled reader can make sense of the actions and 
motivations in such a story through a variety of inferences and 
default assumptions. This involves the use of a wide variety of 
world knowledge from the schema for problem solving, to the schema 
for maids, to the schema for how to con somebody. '\ Different 
readers may misunderstand the ' story in many different: ways 
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depending on whicn of these assumpt ions* or inferences they fail to 
make or which they make incorrectly. • 

Knowledge and Processing at the Interpretive Level 

An understanding of the interrelationships between the 
character and. events in a story' typically requires a host of 
complejc^ inferences. But the goal^ of the skilled reader^ goes 
beyond that of. following the story: in addition, he seeks to 
interpret or impose a structure on the passage as a whole; 
Processing at this level requires even more abstract knowledge and 
ipore complex ^inferences, since it depends less on the actual 
content of the text than it does on the goals .of the reader and 
nis perception of the author's intentions. 

If the reader knows about fables, the Stone Soup story will 
oe much easier for him to interpret. This is because fables are 
constructed according to a regula^r formula. A fable is a short 
story. Its characters, which are often animals, are stereotypes 
(e.g., maids are subservient, rabbits are frivolous, foxes' are 
self-serving and cunning). Fables are generally based oh the 
theme that life requires that we be flexible; the individual |who - 
-is too nearsighted is liable to suffer the consequences — his goals 
will be thwarted or he will be outsmarted; the individual who is 
adaptive and resourceful will ue successful even in the face of 
adversity. ' Any particular fable is intended to convey a more 
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specific 'lesson or moral witnin this theme. The moral is often 
summarjLzed by the last line of the fable. All of this knowledge 
would presumably be organized in a general fable schema* 

For purposes of interpreting the Stone Soup story, the 
reader's first tasK is that of recognizing that it is a fable. If 
this information is not Explicitly given, it may be signalled in 
oottom-up fashion from the structure of the story or from the fact 
that it was authored oy Aesop, Once the fabla schema has been 
suggested, top-down processes will be initiated in the effort to 
satisfy its slots. . Most importantly, tne fable sctiema must (1) 
tind eitner a flexible successful character or a rigid, foiled 
character, and ^ (2) interpret the events leadijig to this 
character's success or failure 4.n terms of some general lesson of 
conducts If the moral werfe summarized in the last line, as is 
often the case with fables, tne reader would be half way there: he 
would only need to relate that synopsis back to the events in the 
story — the relevant characters would be -brought out in the 
process. The moral is not summarized in the last line of the 
Stone Soup story, but th^ fable schema demands that there be one. 
'rhe reader's task is tnerefore to use the event structure of the 
story to discover what the moral could be. 

If tne reader has made the inferences described in the 
previous section, then, he should have constructed an event 
structure for the Stone Soup fable something like the following: 
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l^.^Tne goal of the poor man is to get ''some -.food . 

2. The goal of the maid and the cook is to protect theic master's 
goods. ' - t 

3- Tne man's initial attempt to reach hir-goal is denied by the 

/* • 

' ma id • A ^ ^ 

no 

4. He devises a clever'.,suDter f uge to get part way to,that gbal. 

5. He devises an even cleverer subterfuge to get the rest ot' the. 
way to that goal. , ■ : '\ ' - 

b. Tne cook and the -.-naid are conned into- giving the -man some fo9d 

and, thus, betraying their master against their wills, 
m this fable, Aesop seems to have^Jfrilled two moralsowith one 
stone, vihile the poor man satisfies the f lexible-and-successf ul 
description., the maid and the cook sa-tisfy the r igid-and-foiled 
description. Moreover, both the success of the poor man. andl. 'tk 
plight of the' servants can be translated into g^'eneral lessons "of 
condupt. The generality of these lessons is evidenced by the fact 
that they can.be captured by other maxims: for the man, "where 

o 

there's a will, there's a way;" for the servants, "Beware of 
Greeks bearing gifts." If the reader has recognized these, 
Ic-^sons,. he has understood tne story, in the fullest sense. 

Since schemata at the interpretive level are not compelled by 
t.he cext, one can enjoy and feel like he understands a story 
perfectly well without tnem. One might be fully 'satisfied with 
the Stone Soup story witnout drawing out its lessons. Or one 
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tnight-be entertained by the story of Candy without interpreting it 
as a spoof on Candide. But interpretive schemata add a level of 
understanding th^t may be enlightening and is often critical. We 
would argue that skilled readers have a -^variety of specialized 
schemata, like the fable schema, at the interpretive .level that 
enable them to. read such things as algebra problems, mysteries, 
politipai- essays, allegories, recipes, contracts, and game I 
instructions to their most useful ends. 

XOnCLUSION - ' 1 

The analysis of the Stone Soup fable at these four .different 
levels^ illustrates how "reading compreliension depends' as much on 
the reader's previously acquired knowledge as on the information 
provided by the text. Moreover, comprehension depends on the 
reader's ability to appropriately interrelate his knowledge and 
the textual information both within and between levels of 
,«^nalysis. The powec of schema-theoretic models of reading lies in 
their capacity to support these interactions through, a single, 
stratified knowledge structure and a few basic processing 
mechanisms. 

Top-down and DOttom-up processing are fundamental mechanisms 
jrfhich apply at all levels of analysis. Bottomrup processing 
o'ccur s when scnema ta that have been identif ied suggest other 
candidate schemata at the same, level or the next level up. 
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Examples o^f bottom-up processes at the four levels of ana^iysis 
are: , 

C i) Letters that have Deen identified suggest neighboring letters 
and candidate words. , 
,.-2)-, A determiner sucn as "a" suggests that a noun or adjective 
will follow and that a noun phrase has been started. 

c) Reference to "begging for food" suggests the schemata for 
"obtaining goods" and "trying." 

d) The man's persistent, devious, and successful measures to get 
food suggest a candidate moral such as "where there's- a will, 
there ' s a way. " - 

'fop-down processing ^occurs wiien schemata that have been 
suggested try to find scnemata from the same level or the next 
level^ down to fill out their descriptions. Examples of top-down 
processes at the four levels of analysis are: 

a) A ca\diaate worcl such as MAN looks for M, A, and N to fill 
its three slots. 

b) A noun phrase looks for particular parts of speech, such as a 
determiner or a proper noun, to fill its- initial slot. 

c) The problem salving scliema looks for a goal, such as eating, 
to account for the man begging for fooa. 

a) Tne fable schema looks for a moral as the point of the story. 

As top-down and bottom-up processes operate simultaneously at 
all different levels of analysis, they work to pull the various 

"fragments of knowledge and informatjon into a coherent whole.. 
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~ .Finally., neither the basic knowledge structure nor the 
processing mechanisms tnat have been described are supposed to be* 
.un'i'que to a particular story or even to the reading process in 
general. Rather, within , schema theory, the same knowledge 
structures and processes are supposed underlie all cognitive 
processes. Clearly people must have knowledge about maids, and 
stories, and proDlem-solving , and grammar like' that described 
nere. Such knowledge has many uses in addition to that of 
understanding text. Schema theory provides a way of integrating 
our understanding of text with our understanding of the world in 
general,. 
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